Morphological analysis of a non-standard language variety

نویسندگان

  • Heiki-Jaan Kaalep
  • Kadri Muischnek
چکیده

This article introduces a corpus-based method for improving the process of automatic morphological analysis of a non-standard text variety. More precisely, our paper is concerned with the morphological analysis of Estonian chatroom texts. First, the morphological analyzer designed for the standard written Estonian is used for the analysis of chatroom texts. On the basis of output error analysis a method for improving the process is proposed. We take advantage of the fact that there are deviations with high token frequency, but low type frequency, on the one hand, and deviations with low token frequency, but high type frequency, on the other hand. The first group has to be manually compiled into a user lexicon, whereas the second group of errors can be taken care of by automatic means: automatic preprocessing of texts and automatic complementation of the user lexicon. As a result, the percentage of unknown tokens in the output of the morphological analyzer decreases from 27 to 10.5.

برای دانلود متن کامل این مقاله و بیش از 32 میلیون مقاله دیگر ابتدا ثبت نام کنید

ثبت نام

اگر عضو سایت هستید لطفا وارد حساب کاربری خود شوید

منابع مشابه

Morphological deficits related to noun in Kurdish- Persian bilingual Broca’s aphasic patients

Introduction: One of the major issues in the field of linguistics that has attracted the attention of neurologists, linguists and psychologists of language is bilingual aphasia. this study has been done to investigate the morphological deficits of nouns (singular, plural, and collective) in Kurdish-Persian bilingual Broca’s aphasic patients. Materials and Methods: The research method was descri...

متن کامل

TFW, DamnGina, Juvie, and Hotsie-Totsie: On the Linguistic and Social Aspects of Internet Slang

Slang is ubiquitous on the Internet. The emergence of new social contexts like micro-blogs, question-answering forums, and social networks has enabled slang and non-standard expressions to abound on the web. Despite this, slang has been traditionally viewed as a form of non-standard language – a form of language that is not the focus of linguistic analysis and has largely been neglected. In thi...

متن کامل

Genetic analysis of agronomic and morphological traits of durum wheat [Triticum turgidum L. spp. durum (Desf.)] using generations mean analysis under non-stress and terminal drought stress conditions

Breeders often use generation means analysis to obtain information about inheritance, gene action, and to determine effective breeding methods to improve important agronomic traits, especially under drought stress conditions. To investigate the genetic parameters of agronomic and morphological traits in durum wheat, a field experiment was carried out using F1, F2, BC1 and BC2 generations obtain...

متن کامل

Morphological Analysis for the Maltese Language: The challenges of a hybrid system

Maltese is a morphologically rich language with a hybrid morphological system which features both concatenative and non-concatenative processes. This paper analyses the impact of this hybridity on the performance of machine learning techniques for morphological labelling and clustering. In particular, we analyse a dataset of morphologically related word clusters to evaluate the difference in re...

متن کامل

Exploring Male and Female Iranian EFL Learners’ Attitude towards Native and Non-native Varieties of English

This study investigated whether Iranian EFL learners are aware of different varieties of English spoken throughout the world and whether they have tendency towards a particular variety of English. Likewise, it explored the attitudes of Iranian EFL learners towards the native and non-native varieties of English. Moreover, it made an attempt to investigate whether such attitudes are gender-orient...

متن کامل

ذخیره در منابع من


  با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید

برای دانلود متن کامل این مقاله و بیش از 32 میلیون مقاله دیگر ابتدا ثبت نام کنید

ثبت نام

اگر عضو سایت هستید لطفا وارد حساب کاربری خود شوید

عنوان ژورنال:

دوره   شماره 

صفحات  -

تاریخ انتشار 2011